Improving Vaccine Equity: How Community Engagement and Informatics Facilitate Health System Outreach to Underrepresented Groups.

BACKGROUND: Given the inequities in access to health care resources like COVID-19 vaccination, health systems should carefully consider how to reach underrepresented groups. Reflecting on vaccine rollout efforts holds insight on the role of community engagement and informatics support in promoting health equity. OBJECTIVES: This study aimed to assess the effectiveness of four outreach strategies deployed by University of Washington (UW) Medicine in improving vaccine equity over traditional vaccine scheduling online or by phone, we report on appointment scheduling and completion of appointments (i.e., vaccine administration) through (1) automated outreach to individuals from underrepresented groups, (2) temporary "pop-up" clinics in neighborhoods highly impacted by COVID-19, (3) vulnerable population clinics, and (4) mobile vaccine vans. METHODS: We conducted a 6-month retrospective analysis of electronic health records (EHR) to describe the sociodemographic characteristics of individuals who scheduled appointments using the outreach strategies and characteristics associated with a greater likelihood of vaccine administration based on appointment completion. To help explain trends in the EHR data, we engaged 10 health system leaders and staff who spearheaded the outreach strategies in follow-up conversations to identify qualitative insights into what worked and why. RESULTS: Compared with traditional scheduling, all outreach strategies except vulnerable population clinics had higher vaccine appointment completion rates, including automated outreach (N = 3,734 [94.7%], p < 0.001), pop-up clinics (N = 4,391 [96.0%], p < 0.001), and mobile vans (N = 4,198 [99.1%], p < 0.001); and lower cancellation rates, including automated outreach (N = 166 [1.1%], p < 0.001), pop-up clinics (N = 155 [0.6%], p < 0.001), and mobile vans (N = 0 [0%], p < 0.001). Qualitative insights emphasized ongoing community partnerships and information resources in successful outreach. CONCLUSION: Vaccine equity outreach strategies improved the proportion of patients who scheduled and completed vaccination appointments among populations disproportionately impacted by COVID-19. Engaging community partners and equity-focused informatics tools can facilitate outreach. Lessons from these outreach strategies carry practical implications for health systems to amplify their health equity efforts.

Qualitative Analysis of Perspectives on Lung Transplant among People with Cystic Fibrosis.

RATIONALE: Lung transplant (LTx) is a potentially life-saving treatment option for individuals with advanced cystic fibrosis (CF), but more people with CF (PwCF) and advanced lung disease die each year than undergo transplant in the United States. Little is known about these individuals' LTx information needs and factors influencing their decision-making process related to transplant. OBJECTIVES: To examine PwCF's experiences with, and preferences for, provision of LTx information; to identify transplant information needs that CF clinicians are well-positioned to address. METHODS: We performed semi-structured qualitative interviews in two separate cohorts: PwCF without LTx and PwCF with LTx between July 2019 and June 2020. Questions focused on awareness and knowledge about LTx, perspectives related to communication about transplant in CF clinic, and experiences with LTx. Thematic analysis was utilized to organize the qualitative data. Exemplar quotes were chosen to illustrate domains that emerged pertaining to the research objectives. RESULTS: Fifty-five PwCF, 35 without LTx and 20 with LTx, participated. One-third of PwCF without LTx had normal or near-normal lung function. Key common domains among PwCF with and without LTx were identified including information needs, connections with LTx recipients, and conversations with CF clinicians. For PwCF with and without transplant, concrete information needs were identified: success or survival, social support, surgery, recovery/pain, and quality of life post-transplant. The importance of connecting with LTx recipients to hear their stories and experiences was emphasized by both PwCF with and without transplant. Important considerations for timing and content of discussions with CF clinicians were identified, including having information presented early (before LTx referral is needed) and in limited detail at first. PwCF without LTx wanted to understand how LTx was relevant to them, with a focus on the unique experience of CF. PwCF with LTx emphasized the need for a centralized resource for LTx information. CONCLUSIONS: The findings provide content areas for CF clinicians to focus on as they proactively initiate conversations about LTx and support the development of tools to aid in discussions about LTx for PwCF.

Geospatial divide in real-world EHR data: Analytical workflow to assess regional biases and potential impact on health equity.

Real-world data (RWD) like electronic health records (EHR) has great potential for secondary use by health systems and researchers. However, collected primarily for efficient health care, EHR data may not equitably represent local regions and populations, impacting the generalizability of insights learned from it. We assessed the geospatial representativeness of regions in a large health system EHR data using a spatial analysis workflow, which provides a data-driven way to quantify geospatial representation and identify adequately represented regions. We applied the workflow to investigate geospatial patterns of overweight/obesity and depression patients to find regional "hotspots" for potential targeted interventions. Our findings show the presence of geospatial bias in EHR and demonstrate the workflow to identify spatial clusters after adjusting for bias due to the geospatial representativeness. This work highlights the importance of evaluating geospatial representativeness in RWD to guide targeted deployment of limited healthcare resources and generate equitable real-world evidence.

Integrating patient voices into the extraction of social determinants of health from clinical notes: ethical considerations and recommendations.

Identifying patients' social needs is a first critical step to address social determinants of health (SDoH)-the conditions in which people live, learn, work, and play that affect health. Addressing SDoH can improve health outcomes, population health, and health equity. Emerging SDoH reporting requirements call for health systems to implement efficient ways to identify and act on patients' social needs. Automatic extraction of SDoH from clinical notes within the electronic health record through natural language processing offers a promising approach. However, such automated SDoH systems could have unintended consequences for patients, related to stigma, privacy, confidentiality, and mistrust. Using Floridi et al's "AI4People" framework, we describe ethical considerations for system design and implementation that call attention to patient autonomy, beneficence, nonmaleficence, justice, and explicability. Based on our engagement of clinical and community champions in health equity work at University of Washington Medicine, we offer recommendations for integrating patient voices and needs into automated SDoH systems.

Implementation Fidelity of Chatbot Screening for Social Needs: Acceptability, Feasibility, Appropriateness.

OBJECTIVES: Patient and provider-facing screening tools for social determinants of health have been explored in a variety of contexts; however, effective screening and resource referral remain challenging, and less is known about how patients perceive chatbots as potential social needs screening tools. We investigated patient perceptions of a chatbot for social needs screening using three implementation outcome measures: acceptability, feasibility, and appropriateness. METHODS: We implemented a chatbot for social needs screening at one large public hospital emergency department (ED) and used concurrent triangulation to assess perceptions of the chatbot use for screening. A total of 350 ED visitors completed the social needs screening and rated the chatbot on implementation outcome measures, and 22 participants engaged in follow-up phone interviews. RESULTS: The screened participants ranged in age from 18 to 90 years old and were diverse in race/ethnicity, education, and insurance status. Participants (n = 350) rated the chatbot as an acceptable, feasible, and appropriate way of screening. Through interviews (n = 22), participants explained that the chatbot was a responsive, private, easy to use, efficient, and comfortable channel to report social needs in the ED, but wanted more information on data use and more support in accessing resources. CONCLUSION: In this study, we deployed a chatbot for social needs screening in a real-world context and found patients perceived the chatbot to be an acceptable, feasible, and appropriate modality for social needs screening. Findings suggest that chatbots are a promising modality for social needs screening and can successfully engage a large, diverse patient population in the ED. This is significant, as it suggests that chatbots could facilitate a screening process that ultimately connects patients to care for social needs, improving health and well-being for members of vulnerable patient populations.

Improving physical activity among prostate cancer survivors through a peer-based digital walking program.

Physical activity is important for prostate cancer survivors. Yet survivors face significant barriers to traditional structured exercise programs, limiting engagement and impact. Digital programs that incorporate fitness trackers and peer support via social media have potential to improve the reach and impact of traditional support. Using a digital walking program with prostate cancer survivors, we employed mixed methods to assess program outcomes, engagement, perceived utility, and social influence. After 6 weeks of program use, survivors and loved ones (n=18) significantly increased their average daily step count. Although engagement and perceived utility of using a fitness tracker and interacting with walking buddies was high, social media engagement and utility were limited. Group strategies associated with social influence were driven more by group attraction to the collective task of walking than by interpersonal bonds. Findings demonstrate the feasibility of a digital walking program to improve physical activity and extend the reach of traditional support.

Co-designing mind-body technologies for sleep with adolescents.

Sleep is critical for well-being, yet adolescents do not get enough sleep. Mind-body approaches can help. Despite the potential of technology to support mind-body approaches for sleep, there is a lack of research on adolescent preferences for digital mind-body technology. We use co-design to examine adolescent perspectives on mind-body technologies for sleep. From our analysis of design sessions with 16 adolescents, four major themes emerged: system behavior, modality, content, and context. In light of these key findings, we recommend that technology-based mind-body approaches to sleep for adolescents be designed to 1) serve multiple functions while avoiding distractions, 2) provide intelligent content while maintaining privacy and trust, 3) provide a variety of content with the ability to customize and personalize, 4) offer multiple modalities for interaction with technology, and 5) consider the context of adolescent and their families. Findings provide a foundation for designing mind-body technologies for adolescent sleep.

Imagining Improved Interactions: Patients' Designs To Address Implicit Bias.

Implicit biases may negatively influence healthcare providers' behaviors toward patients from historically marginalized communities, impacting providers' communication style, clinical decision-making, and delivery of quality care. Existing interventions to mitigate negative experiences of implicit biases are primarily designed to increase recognition and management of stereotypes and prejudices through provider-facing tools and resources. However, there is a gap in understanding and designing interventions from patient perspectives. We conducted seven participatory co-design workshops with 32 Black, Indigenous, People of Color (BIPOC), Lesbian, Gay, Bisexual, Transgender, Queer/Questioning (LGBTQ+), and Queer, Transgender, Black, Indigenous, People of Color (QTBIPOC) individuals to design patient-centered interventions that help them address and recover from provider implicit biases in primary care. Participants designed four types of solutions: accountability measures, real-time correction, patient enablement tools, and provider resources. These informatics interventions extend the research on implicit biases in healthcare through inclusion of valuable, firsthand patient perspectives and experiences.

Take on transplant: human-centered design of a patient education tool to facilitate informed discussions about lung transplant among people with cystic fibrosis.

OBJECTIVE: Lung transplant (LTx) saves lives in cystic fibrosis (CF). However, many potential candidates express uncertainty about LTx and die before receiving this treatment. CF guidelines recommend LTx education and clinical discussions well before the need for LTx arises, but limited patient resources exist. MATERIALS AND METHODS: We engaged people with CF and CF physicians in human-centered design of "Take On Transplant" (TOT), a web-based education tool to prepare patients for LTx discussions. Across 3 phases, needs assessment, design groups, and iterative user testing of TOT, we refined TOT from wireframe prototypes, to an interactive website, to a fully functional intervention ready for clinical trials. RESULTS: Fifty-five people with CF and 105 physicians identified information needs to prepare for LTx discussions. Design groups (n = 14 participants) then established core requirements: didactic education ("Resource Library"), patient narratives ("CF Stories"), frequently asked questions ("FAQ"), and self-assessment to tailor content ("My CF Stage"). Iterative usability testing (n = 39) optimized the design of CF Stories and prototype layout. We then developed the TOT website and demonstrated feasibility and preliminary efficacy of use through 2-week field testing (n = 9). DISCUSSION: Our human-centered design process provided guidance for educational tools to serve the evolving needs of potential LTx candidates. Our findings support the process of patient deliberation as a foundation for shared decision-making in CF, and inform educational tools that could potentially translate beyond LTx. CONCLUSION: TOT fills a critical gap in preparing people with CF for shared decision-making about LTx and may serve as a model for educational tools for other preference-sensitive decisions.

Comprehension, utility, and preferences of prostate cancer survivors for visual timelines of patient-reported outcomes co-designed for limited graph literacy: meters and emojis over comics.

OBJECTIVE: Visual timelines of patient-reported outcomes (PRO) can help prostate cancer survivors manage longitudinal data, compare with population averages, and consider future trajectories. PRO visualizations are most effective when designed with deliberate consideration of users. Yet, graph literacy is often overlooked as a design constraint, particularly when users with limited graph literacy are not engaged in their development. We conducted user testing to assess comprehension, utility, and preference of longitudinal PRO visualizations designed for prostate cancer survivors with limited literacy. MATERIALS AND METHODS: Building upon our prior work co-designing longitudinal PRO visualizations with survivors, we engaged 18 prostate cancer survivors in a user study to assess 4 prototypes: Meter, Words, Comic, and Emoji. During remote sessions, we collected data on prototype comprehension (gist and verbatim), utility, and preference. RESULTS: Participants were aged 61-77 (M = 69), of whom half were African American. The majority of participants had less than a college degree (95%), had inadequate health literacy (78%), and low graph literacy (89%). Among the 4 prototypes, Meter had the best gist comprehension and was preferred. Emoji was also preferred, had the highest verbatim comprehension, and highest rated utility, including helpfulness, confidence, and satisfaction. Meter and Words both rated mid-range for utility, and Words scored lower than Emoji and Meter for comprehension. Comic had the poorest comprehension, lowest utility, and was least preferred. DISCUSSION: Findings identify design considerations for PRO visualizations, contributing to the knowledge base for visualization best practices. We describe our process to meaningfully engage patients from diverse and hard-to-reach groups for remote user testing, an important endeavor for health equity in biomedical informatics. CONCLUSION: Graph literacy is an important design consideration for PRO visualizations. Biomedical informatics researchers should be intentional in understanding user needs by involving diverse and representative individuals during development.

Maybe they had a bad day: how LGBTQ and BIPOC patients react to bias in healthcare and struggle to speak out.

OBJECTIVE: People who experience marginalization, including Black, Indigenous, People of Color (BIPOC) and Lesbian, Gay, Bisexual, Transgender, Queer, Plus (ie, all other marginalized genders and sexual orientations) people (LGBTQ+) experience discrimination during healthcare interactions, which negatively impacts patient-provider communication and care. Yet, scarce research examines the lived experience of unfair treatment among patients from marginalized groups to guide patient-centered tools that improve healthcare equity. MATERIALS AND METHODS: We interviewed 25 BIPOC and/or LGBTQ+ people about their experiences of unfair treatment and discrimination when visiting healthcare providers. Through thematic analysis, we describe participants' immediate reactions and longer-term consequences of those experiences. RESULTS: We identified 4 ways that participants reacted to discrimination in the moment: Fighting, Fleeing, Excusing, and Working Around Bias. Long-term consequences reflect 6 ways they coped: Delaying or Avoiding Care, Changing Healthcare Providers, Self-prescribing, Covering Behaviors, Experiencing Health Complications, and Mistrusting Healthcare Institutions. DISCUSSION: By describing how patients react to experiences of unfair treatment and discrimination, our findings enhance the understanding of health disparities as patients cope and struggle to speak out.To combat these problems, we identify 3 future directions for informatics interventions that improve provider behavior, support patient advocacy, and address power dynamics in healthcare. CONCLUSIONS: BIPOC and LGBTQ+ patients' perspectives on navigating unfair treatment and discrimination in healthcare offers critical insight into their experiences and long-term consequences of those experiences. Understanding the circumstances and consequences of unfair treatment, discrimination, and the impact of bias through this patient-centered lens is crucial to inform informatics technologies that promote health equity.

Battling Bias in Primary Care Encounters: Informatics Designs to Support Clinicians.

Although clinical training in implicit bias is essential for healthcare equity, major gaps remain both for effective educational strategies and for tools to help identify implicit bias. To understand the perspectives of clinicians on the design of these needed strategies and tools, we conducted 21 semi-structured interviews with primary care clinicians about their perspectives and design recommendations for tools to improve patient-centered communication and to help mitigate implicit bias. Participants generated three types of solutions to improve communication and raise awareness of implicit bias: digital nudges, guided reflection, and data-driven feedback. Given the nuance of implicit bias communication feedback, these findings illustrate innovative design directions for communication training strategies that clinicians may find acceptable. Improving communication skills through individual feedback designed by clinicians for clinicians has the potential to improve healthcare equity.

Approaches for implementing digital interventions for alcohol use disorders in primary care: A qualitative, user-centered design study.

Background: Digital interventions, such as smartphone apps, can be effective in treating alcohol use disorders (AUD). However, efforts to integrate digital interventions into primary care have been challenging. To inform successful implementation, we sought to understand how patients and clinicians preferred to use apps in routine primary care. Methods: This study combined user-centered design and qualitative research methods, interviewing 18 primary care patients with AUD and nine primary care clinicians on topics such as prior experiences with digital tools, and design preferences regarding approaches for offering apps for AUD in primary care. Interviews were recorded and transcribed for template analysis whereby a priori codes were based on interview topics and refined through iterative coding. New codes and cross-cutting themes emerged from the data. Results: Patient participants with AUD indicated they would be more likely to engage in treatment if primary care team members were involved in their use of apps. They also preferred to see clinicians "invested" and recommended that clinicians ask about app use and progress during follow-up appointments or check-ins. Clinician participants valued the opportunity to offer apps to their patients but noted that workflows would need to be tailored to individual patient needs. Time pressures, implementation complexity, and lack of appropriate staffing were cited as barriers. Clinicians proposed concrete solutions (e.g., education, tools, and staffing models) that could improve their ability to use apps within the constraints of primary care and suggested that some patients could potentially use apps without clinician support. Conclusions: A user-centered approach to engaging patients in digital alcohol interventions in primary care may require personalized support for both initiation and follow-up. Meeting patients' needs likely require increased staffing and efficient workflows in primary care. Health systems should consider offering multiple pathways for enrolling patients in apps to accommodate individual preferences and contextual barriers. Plain Language Summary: Healthcare systems have begun using app-based treatments to help patients manage their health conditions, including alcohol use disorders. Some apps have been tested in research studies and appear to be effective. However, it is difficult for healthcare teams to offer apps to patients. Clinicians must engage in new activities that they have not done before, such as "teaching" patients to use apps and checking in on their use of the apps. Identifying how to use apps in routine healthcare is critical to their successful implementation. This study interviewed 27 people, including healthcare providers and patients in primary care, to uncover the most optimal ways to offer apps to patients with alcohol use disorders. The interviews combined the use of qualitative research methods and user-centered design. Results suggest that to use to address alcohol use disorders, primary care teams should be prepared to offer personalized support to patients. Both patient and clinician interviewees said that the steps required to use apps must be intuitive and simple. Patients could gain more benefits if clinicians introduced the apps and guided patients to use them, as opposed to making apps available for patients to download and use on their own. However, the exact approach to offering apps would depend on a given patient's preferences and the extent that staffing was available in the clinic to support patients. Health systems should be prepared to offer and support patients in their use of apps, which should accommodate patient preferences and the constraints of the clinic.

Identifying opportunities for informatics-supported suicide prevention: the case of Caring Contacts.

Suicide is the tenth leading cause of death in the United States. Caring Contacts (CC) is a suicide prevention intervention involving care teams sending brief messages expressing unconditional care to patients at risk of suicide. Despite solid evidence for its effectiveness, CC has not been broadly adopted by healthcare organizations. Technology has the potential to facilitate CC if barriers to adoption were better understood. This qualitative study assessed the needs of organizational stakeholders for a CC informatics tool through interviews that investigated barriers to adoption, workflow challenges, and participant-suggested design opportunities. We identified contextual barriers related to environment, intervention parameters, and technology use. Workflow challenges included time-consuming simple tasks, risk assessment and management, the cognitive demands of authoring follow-up messages, accessing and aggregating information across systems, and team communication. To address these needs, we propose design considerations that focus on automation, cognitive support, and data and workflow integration. Future work will incorporate these findings to design informatics tools supporting broader adoption of Caring Contacts.

Comparing Caregiving Needs in Asian And White Family Caregivers through a Journaling Exercise Delivered by a Conversational Agent.

Asian Americans are the fastest growing racial and ethnic group with nearly 1 in 5 self-identifying as a family caregiver. Understanding the needs of ethnic minority caregivers is needed to develop inclusive technology solutions that aim to support caregivers within these marginalized communities in managing their own health. This study aimed to describe and compare the common needs of Asian American (AA) and White caregivers through data collected using a short message service-based conversational agent. Caregivers (26 AA and 84 White) shared their daily experiences for 14 days, and the data were analyzed using directed content analysis to identify needs based on Maslow's Hierarchy of Needs. Overall, AA and White caregivers expressed different needs in physiological, safety, and esteem categories. Culturally tailored support and resources are needed for family caregivers from diverse cultural and ethnic backgrounds.

Usability preferences of people living with cystic fibrosis about a lung transplant education website.

People living with cystic fibrosis (CF) need educational resources about lung transplant prior to engaging in shared decision making with their medical providers. We conducted a usability study to elicit preferences of people living with CF about how didactic and experiential content could be used in an educational resource to learn about lung transplant. We created two prototypes with different design features that participants used in a scenario-based task and evaluated using the System Usability Scale. We interviewed participants and analyzed the data to understand their preferences for educational content and design. Study participants indicated that didactic resource articles were important to understanding their illness trajectory, while experiential patient stories supported fear reduction and knowledge discovery. When learning about lung transplant participants stated a preference to control the amount of information they receive and preferred a combination of didactic and experiential knowledge.

Exploring needs, interests and preferences for digital mind-body tools for adolescents.

Sleep problems are common among adolescents and research on mind-body interventions for sleep is promising. Although technology-based mind-body interventions have been shown to help early adolescents with practicing mind-body approaches, engagement and adherence has been a challenge. Using a Human-Centered Design framework with semi-structured interviews with parent-adolescent dyads, we describe exposure to, interest in, and preferences for digital mind-body technology for sleep. Identified challenges (e.g., 'establish routine', 'busy schedule) and preferences (e.g., age-appropriate content) reflect mind-body technology needs that impact engagement. Based on these findings, we recommend that a technology-based mind-body approach for early adolescents be designed to 1) provide content customized for adolescents 2) include functionalities that engage adolescents like games and rewards, and 3) allow for granular sharing controls. These recommendations provide a foundation for designing digital mind-body tools for adolescents.

A learning health systems approach to integrating electronic patient-reported outcomes across the health care organization.

INTRODUCTION: Foundational to a learning health system (LHS) is the presence of a data infrastructure that can support continuous learning and improve patient outcomes. To advance their capacity to drive patient-centered care, health systems are increasingly looking to expand the electronic capture of patient data, such as electronic patient-reported outcome (ePRO) measures. Yet ePROs bring unique considerations around workflow, measurement, and technology that health systems may not be poised to navigate. We report on our effort to develop generalizable learnings that can support the integration of ePROs into clinical practice within an LHS framework. METHODS: Guided by action research methodology, we engaged in iterative cycles of planning, acting, observing, and reflecting around ePRO use with two primary goals: (1) mobilize an ePRO community of practice to facilitate knowledge sharing, and (2) establish guidelines for ePRO use in the context of LHS practice. Multiple, emergent data collection activities generated generalizable guidelines that document the tangible best practices for ePRO use in clinical care. We organized guidelines around thematic areas that reflect LHS structures and stakeholders. RESULTS: Three core thematic areas (and 24 guidelines) emerged. The theme of governance reflects the importance of leadership, knowledge management, and facilitating organizational learning around best practice models for ePRO use. The theme of integration considers the intersection of workflow, technology, and human factors for ePROs across areas of care delivery. Lastly, the theme of reporting reflects critical considerations for curating data and information, designing system functions and interactions, and presentation of ePRO data to support the translation of knowledge to action. CONCLUSIONS: The guidelines produced from this work highlight the complex, multidisciplinary nature of implementing change within LHS contexts, and the value of action research approaches to enable rapid, iterative learning that leverages the knowledge and experience of communities of practice.

Approaches for Implementing App-Based Digital Treatments for Drug Use Disorders Into Primary Care: A Qualitative, User-Centered Design Study of Patient Perspectives.

BACKGROUND: Digital interventions, such as websites and smartphone apps, can be effective in treating drug use disorders (DUDs). However, their implementation in primary care is hindered, in part, by a lack of knowledge on how patients might like these treatments delivered to them. OBJECTIVE: This study aims to increase the understanding of how patients with DUDs prefer to receive app-based treatments to inform the implementation of these treatments in primary care. METHODS: The methods of user-centered design were combined with qualitative research methods to inform the design of workflows for offering app-based treatments in primary care. Adult patients (n=14) with past-year cannabis, stimulant, or opioid use disorder from 5 primary care clinics of Kaiser Permanente Washington in the Seattle area participated in this study. Semistructured interviews were recorded, transcribed, and analyzed using qualitative template analysis. The coding scheme included deductive codes based on interview topics, which primarily focused on workflow design. Inductive codes emerged from the data. RESULTS: Participants wanted to learn about apps during visits where drug use was discussed and felt that app-related conversations should be incorporated into the existing care whenever possible, as opposed to creating new health care visits to facilitate the use of the app. Nearly all participants preferred receiving clinician support for using apps over using them without support. They desired a trusting, supportive relationship with a clinician who could guide them as they used the app. Participants wanted follow-up support via phone calls or secure messaging because these modes of communication were perceived as a convenient and low burden (eg, no copays or appointment travel). CONCLUSIONS: A user-centered implementation of treatment apps for DUDs in primary care will require health systems to design workflows that account for patients' needs for structure, support in and outside of visits, and desire for convenience.

Comparison of women and men in biomedical informatics scientific dissemination: retrospective observational case study of the AMIA Annual Symposium: 2017-2020.

OBJECTIVE: Although the representation of women in science has improved, women remain underrepresented in scientific publications. This study compares women and men in scholarly dissemination through the AMIA Annual Symposium. MATERIALS AND METHODS: Through a retrospective observational study, we analyzed 2017-2020 AMIA submissions for differences in panels, papers, podium abstracts, posters, workshops, and awards for men compared with women. We assigned a label of woman or man to authors and reviewers using Genderize.io, and then compared submission and acceptance rates, performed regression analyses to evaluate the impact of the assumed gender, and performed sentiment analysis of reviewer comments. RESULTS: Of the 4687 submissions for which Genderize.io could predict man or woman based on first name, 40% were led by women and 60% were led by men. The acceptance rate was smilar. Although submission and acceptance rates for women increased over the 4 years, women-led podium abstracts, panels, and workshops were underrepresented. Men reviewers increased the odds of rejection. Men provided longer reviews and lower reviewer scores, but women provided reviews that had more positive words. DISCUSSION: Overall, our findings reflect significant gains for women in the 4 years of conference data analyzed. However, there remain opportunities to improve representation of women in workshop submissions, panel and podium abstract speakers, and balanced peer reviews. Future analyses could be strengthened by collecting gender directly from authors, including diverse genders such as non-binary. CONCLUSION: We found little evidence of major bias against women in submission, acceptance, and awards associated with the AMIA Annual Symposium from 2017 to 2020. Our study is unique because of the analysis of both authors and reviewers. The encouraging findings raise awareness of progress and remaining opportunities in biomedical informatics scientific dissemination.